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In this paper, we review some features of quantum annealing and related topics 
from viewpoints of statistical physics, condensed matter physics, and compu- 
tational physics. We can obtain a better solution of optimization problems in 
many cases by using the quantum annealing. Actually the efficiency of the 
quantum annealing has been demonstrated for problems based on statistical 
physics. Then the quantum annealing has been expected to be an efficient and 
generic solver of optimization problems. Since many implementation methods 
of the quantum annealing have been developed and will be proposed in the 
future, theoretical frameworks of wide area of science and experimental tech- 
nologies will be evolved through studies of the quantum annealing. 

Keywords: Quantum annealing; Quantum information; Ising model; Optimiza- 
tion problem 



1. Introduction 

Optimization problems are present almost everywhere, for example, de- 
signing of integrated circuit, staff assignment, and selection of a mode of 
transportation. To find the best solution of optimization problems is diffi- 
cult in general. Then, it is a significant issue to propose and to develop a 
method for obtaining the best solution (or a better solution) of optimiza- 
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tion problems in information science. In order to obtain the best solution, a 
couple of algorithms according to type of optimization problems have been 
formulated in information science and these methods have yielded practical 
applications. Furthermore, since optimization problem is to find the state 
where a real-valued function takes the minimum value, it can be regarded 
as problem to obtain the ground state of the corresponding Hamiltonian. 
Thus, if we can map optimization problem to well-defined Hamiltonian, 
we can use knowledge and methodologies of physics. Actually, in computa- 
tional physics, generic and powerful algorithms which can be adopted for 
wide application have been proposed. One of famous methods is simulated 
annealing which was proposed by Kirkpatrick et al. ' In the simulated an- 
nealing, we introduce a temperature (thermal fluctuation) in the considered 
optimization problems. We can obtain a better solution of the optimization 
problem by decreasing temperature gradually since thermal fluctuation ef- 
fect facilitates transition between states. It is guaranteed that we can obtain 
the best solution definitely if we decrease temperature slow enough. 3 Then, 
the simulated annealing has been used in many cases because of easy im- 
plementation and guaranty. 

The quantum annealing was proposed as an alternative method of the 
simulated annealing. 4-11 In the quantum annealing, we introduce a quan- 
tum field which is appropriate for the considered Hamiltonian. For instance, 
if the considered optimization problem can be mapped onto the Ising model, 
the simplest form of the quantum fluctuation is transverse field. In the quan- 
tum annealing, we gradually decrease quantum field (quantum fluctuation) 
instead of temperature (thermal fluctuation). The efficiency of the quan- 
tum annealing has been demonstrated by a number of researchers, and it 
has been reported that a better solution can be obtained by the quantum 
annealing comparison with the simulated annealing in many cases. Figure 
1 shows schematic picture of the simulated annealing and the quantum an- 
nealing. In optimization problems, our target is to obtain the stable state 
at zero temperature and zero quantum field, which is indicated by the solid 
circle in Fig. 1. 

Recently, methods in which we decrease temperature and quantum field 
simultaneously have been proposed and as a result, we can obtain a better 
solution than the simulated annealing and the simple quantum anneal- 
ing. 12-14 Moreover, as an another example of methods in which we use 
both thermal fluctuation and quantum fluctuation, novel quantum anneal- 
ing method with the Jarzynski equality 15 ' 16 was also proposed, 17 which is 
based on nonequilibrium statistical physics. 
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Fig. 1. Schematic picture of the simulated annealing and the quantum annealing. Our 
purpose is to obtain the ground state at the point indicated by the solid circle. 



In this paper, we review the quantum annealing method which is the 
generic and powerful tool for obtaining the best solution of optimization 
problems from viewpoints of statistical physics, condensed matter physics, 
and computational physics. The organization of this paper is as follows. In 
Sec. 2, we review the Ising model which is a fundamental model of magnetic 
systems. The realization method of the Ising model by nuclear magnetic 
resonance is also explained. In Sec. 3, we show a couple of implementation 
methods of the quantum annealing. In Sec. 4, we explain two optimiza- 
tion problems - traveling salesman problem and clustering problem. The 
quantum annealing based on the Monte Carlo method for the traveling 
salesman problem is also demonstrated. In Sec. 5, we review related topics 
of the quantum annealing - Kibble-Zurek mechanism of the Ising spin chain 
and order by disorder in frustrated systems. In Sec. 6, we summarize this 
paper briefly and give some future perspectives of the quantum annealing. 



2. Ising Model 

In this section we introduce the Ising model which is a fundamental model 
in statistical physics. A century ago, the Ising model was proposed to ex- 
plain cooperative nature in strongly correlated magnetic systems from a 
microscopic viewpoint. 18 The Hamiltonian of the Ising model is given by 

N 

Rising = - X] Ji i a i (7 3 ~^Z h i a i^ °i = ±:L > W 

i,j i=l 

where the summation of the first term runs over all interactions on the 
defined graph and N represents the number of spins. If the sign of Jij is 
positive/negative, the interaction is called ferromagnetic/antiferromagnetic 
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interaction. Spins which are connected by ferromagnctic/antifcrromagnctic 
interaction tend to be the same/opposite direction. The second term of the 
Hamiltonian denotes the site-dependent longitudinal magnetic fields. Al- 
though the Ising model is quite simple, this model exhibits inherent rich 
properties e.g. phase transition and dynamical behavior such as melting 
process and slow relaxation. For instance, the ferromagnetic Ising model 
with homogeneous interaction (J,j = J for Vi, j) and no external magnetic 
fields (hi = for Vi) on square lattice exhibits the second-order phase 
transition, whereas no phase transition occurs in the Ising model on one- 
dimensional lattice. Onsager first succeeded to obtain explicitly free energy 
of the Ising model without external magnetic field on square lattice. 19 After 
that, a couple of calculation methods were proposed. Furthermore, these 
calculation methods have been improved day by day, and the new tech- 
niques which were developed in these methods have been applied for other 
more complicated problems. Since the Ising model is quite simple, we can 
easily generalize the Ising model in diverse ways such as the Blumc-Capcl 
model, 20,21 the clock model, 22,23 and the Potts model. 24,25 By analyzing 
these models, relation between nature of phase transition and the symme- 
try which breaks at the transition point has been investigated. Then, it is 
not too much to say that the Ising model has opened up a new horizon for 
statistical physics. 

The Ising model can be adopted for not only magnetic systems but also 
systems in wide area of science such as information science. Optimization 
problem is one of important topics in information science. As we mention in 
Sec. 4, optimization problem can be mapped onto the Ising model and its 
generalized models in many cases. Then some methods which were devel- 
oped in statistical physics often have been used for optimization problem. 
In Sec. 2.1, we show a couple of magnetic systems which can be well rep- 
resented by the Ising model. In Sec. 2.2, we review how to create the Ising 
model by Nuclear Magnetic Resonance (NMR) technique as an example of 
experimental realization of the Ising model. 
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2.1. Magnetic Systems 

In many cases, the Hamiltonian of magnetic systems without external mag- 
netic field is given by 

u = - 22 jjjgj ■<jj 

where erf denotes the a-componcnt of the Pauli matrix at the i-th site. The 
form of this interaction is called Heisenberg interaction. The definitions of 
Pauli matrices are 

"=-(")■ —Oo)- —C- .). < s » 

where the bases are defined by 

lt,:=(J), I;,:-©- M 

In this case, magnetic interactions are isotropic. However, they become 
anisotropic depending on the surrounded ions in real magnetic materials. 
In general, the Hamiltonian of magnetic systems should be replaced by 

H = ~ J2 K + c v°V°] + ■ ( 5 ) 

When \c x \, \cy\ > |c 2 |, the xy- plane is easy-plane and the Hamiltonian be- 
comes XY-like Hamiltonian. On the contrary, when \c z \ > | | , \cy I, the z- 
axis is easy-axis and the Hamiltonian becomes Ising-like Hamiltonian. Such 
anisotropy comes from crystal structure, spin-orbit coupling, and dipolc- 
dipole coupling. Moreover, even if there is almost no anisotropy in magnetic 
interactions, magnetic systems can be regarded as the Ising model when the 
number of electrons in the magnetic ion is odd and the total spin is half- 
integer. In this case, doubly degenerated states exist because of the Kramers 
theorem. These states are called the Kramers doublet. When the energy dif- 
ference between the ground states and the first-excited states AE is large 
enough, these doubly-degenerated ground states can be well represented by 
the S = 1/2 Ising spins. Table 1 shows examples of the magnetic materials 
which can be well represented by the Ising model on one-dimensional chain, 
two-dimensional square lattice, and three-dimensional cubic lattice. 



Table 1. Examples of magnetic materials which can be represented by the Ising model on chain (one-dimension), 
square lattice (two-dimension), and cubic lattice (three-dimension). 



Material 


Spatial dimension 


Total spin 


Type of interaction 


J/k B 


References 


K 3 Fe(CN) 6 


One (chain) 


1 
2 


Antiferromagnctic 


-0.23 K 


26-28 


CsCoCl 3 


One (chain) 


1 
2 


Antiferromagnetic 


-100 K 


29,30 


Dy(C 2 H 5 S04)2 ■ 9 H 2 


One (chain) 


1 
2 


Ferromagnetic 


0.2 K 


31-33 


C0CI2 • 2NC5H5 


One (chain) 


1 
2 


Ferromagnetic 


9.5 K 


34,35 


CoCs 3 Br 5 


Two (square) 


1 
2 


Antiferromagnctic 


-0.23 K 


36-38 


Co(HCOO) 2 ■ 2 H 2 


Two (square) 


1 
2 


Antiferromagnetic 


-4.3 K 


39-42 


Rb 2 CoF 4 


Two (square) 


1 
2 


Antiferromagnetic 


-91 K 


43,44 


FeCl 2 


Two (square) 


1 


Ferromagnetic 


3.4 K 


45,46 


DyP0 4 


Three (cubic) 


1 

2 


Antiferromagnctic 


-2.5 K 


47-50 


Dy 3 Al 5 Oi 2 


Three (cubic) 


1 
2 


Antiferromagnetic 


-1.85 K 


51-53 


CoRb 3 Cl 5 


Three (cubic) 


1 

2 


Antiferromagnctic 


-0.511 K 


54,55 


FeF 2 


Three (cubic) 


2 


Antiferromagnctic 


-2.69 K 


56-59 
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2.2. Nuclear Magnetic Resonance 

In condensed matter physics, Nuclear Magnetic Resonance (NMR) has been 
used for decision of the structure of organic compounds and for analysis 
of the state in materials by using resonance induced by electromagnetic 
wave. The NMR can create the Ising model with transverse fields, which is 
expected to become an element of quantum information processing. In this 
processing, we use molecules where the coherence times are long compared 
with typical gate operations. Actually a couple of molecules which have 
nuclear spins were used for demonstration of quantum computing. 60-75 In 
this section we explain how to create the Ising model by NMR. 

The setup of the NMR spectrometer as a tool of quantum computing 
is as follows. We first put molecules which contain nuclear spins under the 
strong magnetic field Bq. Next we apply radio frequency u/ 1 ^ magnetic field 
which is perpendicular to the strong magnetic field Bq. For simplicity, we 
here consider a molecule which contains two spins. We also assume that the 
considered molecule can be well described by the Heiscnberg Hamiltonian. 
Then the Hamiltonian of this system is given by 

n = n mol + n i * f) +uf\ (6) 

where ?i mo i, ~Hi\ and are defined by 



^mol 



= -hi&l - h 2 &l - J{&1 ■ of + of ■ a\ + of ■ of), (7) 
= -ri cos^k - fa)(8f + j'a%), (8) 
= -r 2 cos(^ - ^(V^i + 5f ), (9) 



respectively. We take the natural unit in which h = 1. The values of </>i and 
4>2 are the phases at the time t — of the first spin and that of the second 
spin, respectively. The quantities of hi are defined by hi := ^iBg, where 7* 
denotes the gyromagnetic ratio of the z-th spin (i = 1,2). The values of hi 
and hi represent energy differences between |f) and \\) of the first spin and 
the second spin, respectively. The coefficients Ti and T2 in H± and 
are the effective amplitudes of the ac magnetic field, whose definitions are 
r*j := 7,i?ac, where B ac is amplitude of the ac magnetic field. The value of 
7' is defined by the ratio of the gyromagnetic ratios 7' := 72/71- 
We define the following unitary transformation: 



We can change from the laboratory frame to a frame rotating with hi around 
the z-axis by using the above unitary transformation. The dynamics of a 
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density matrix can be calculated by 



(ii) 



The density matrix on the rotating frame is given by 

pF> : = U^pU^. (12) 

To be the same form as Eq. (11) on the rotating frame, the Hamiltonian 
on the rotating frame should be 

,d£( R )t 



at 



Here we decompose the Hamiltonian on the rotating frame as 
where the three terms are defined by 



^(R)(rf) 



H 



(R) 



mol ' — w "-molt 

#(R)(rf) ;= t/(R)^(rf)[/(R)t ; 

£(R)(rf) ;= t/(R)^(rf)^(R)t. 



dt 



(13) 
(14) 

(15) 

(16) 
(17) 



The intramolecular magnetic interaction Hamiltonian on the rotating frame 
^moi can b e calculated as 



H 



(R) 
mol 



J 



o 



Jo-ftrf 



-J&l&l. 



(18) 



0\ 

Qi(h 2 -hi)t q 

e^ 2 "' 11 )' 
\0 0/ 

The approximation is valid when \h 2 — hi\r 1, where r is a characteristic 
time scale since the exponential terms are averaged to vanish. The radio 
frequency magnetic field Hamiltonian on the rotating frame under 
the resonance condition cj' rf ) = h, can be calculated as 



£(R)(rf) 



where a_ 



( 

o 

Vo 









o / 



+ 7 



/ a__ \ 
a ++ 
a__ 
\ a ++ / 



-i(h 2 -hi)t+4>i _j_ c -i(h 1 +h 2 )t-<p 1 an(; i 
,(R)(rf) 



a +H 



e i(h 2 -h 1 )t+<p 1 , 



e i(/n+h2)t-^i, Tne second term of ?4 ; vanishes when |/n + /i 2 |r, |/i 2 
3> 1. Then under these conditions, the Hamiltonian becomes 



(R)(rf) 



— ri(cos ^iCT; +sin0 1 af) 



(19) 



March 2, 2013 16:33 



WSPC - Proceedings Trim Size: 9in x 6in Tanaka'KLN'main 



9 

In the same way, the Hamiltonian 'H 2 R ^ rf - ) can be calculated as 

H 2 R)(rf) = -r 2 (cos foa x 2 + sin fool). (20) 

By taking the rotation operators on the individual sites, we can rewrite the 
Hamiltonians ti^^ and 'H 2 R ^ rf ' ) by only the rr-component of the Pauli 
matrix: 

e #iaf^(H.)(rf) e _ #1 ^ = _ ri5 a > (21) 
e # 2 ^^,(R)(rf) e -i^^ = _ T2& x (22) 

Then, the total Hamiltonian can be represented by the Ising model with 
site-dependent transverse fields: 

^( R ) = -J&1&I - ridf - r a 5f . (23) 

It should be noted that the above procedure is not restricted for two spin 
system. Then, the NMR technique can be create the Ising model with site- 
dependent transverse fields in general. 

3. Implementation Methods of Quantum Annealing 

As stated in Sec. 1, the quantum annealing method is expected to be a 
powerful tool to obtain the best solution of optimization problems in a 
generic way. The quantum annealing methods can be categorized according 
to how to treat timc-dcvclopmcnt. One is a stochastic method such as the 
Monte Carlo method which will be shown in Sec. 3.1. Other is a determin- 
istic method such as mean-field type method and real-time dynamics. We 
will explain the mean-field type method and the method based on real-time 
dynamics in Sees. 3.2 and 3.3. Although in the Monte Carlo method and 
the mean-field type method, we introduce time-development in an artificial 
way, the merit of these methods is to be able to treat large-scale systems. 
The methods based on the Schrddinger equation can follow up real-time 
dynamics which occurs in real experimental systems. However, these meth- 
ods can be used for very small systems and/or limited lattice geometries 
because of limited computer resources and characters of algorithms. Each 
method has strengths and limitations based on its individuality. Then when 
we use the quantum annealing, we have to choose implementation methods 
according to what we want to know. In this section, we explain three types 
of theoretical methods for the quantum annealing and some experimental 
results which relate to the quantum annealing. 
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3.1. Monte Carlo Method 



In this section we review the Monte Carlo method as an implementation 
method of the quantum annealing. In physics, the Monte Carlo method is 
widely adopted for analysis of equilibrium properties of strongly correlated 
systems such as spin systems, electric systems, and bosonic systems. Origi- 
nally the Monte Carlo method is used in order to calculate integrated value 
of given function. The simplest example is "calculation of 7r" . Suppose we 
consider a square in which — 1 < x, y < 1 and a circle whose radius is unity 
and center is (x, y) = (0, 0). We generate pair of uniform random numbers 
(— 1 < Xi,yi < 1) many times and calculate the following quantity: 



number of steps when \/ x\ + yf < 1 is satisfied 
number of steps 

Hereafter we refer to the denominator as Monte Carlo step. The quantity 
should converge to ir/4 in the limit of infinite Monte Carlo step. This is a 
pedagogical example of the Monte Carlo method. We first explain how to 
implement and theoretical background of the Monte Carlo method which 
is used in physics. 

In equilibrium statistical physics, we would like to know the equilib- 
rium value at given temperature T. The equilibrium value of the physical 
quantity which is represented by the operator O is defined as 

i ^ TrOe~' 3 ' H 

(o) { T q) := ^mr, (25) 

where Tr means the trace of matrix and /3 denotes the inverse temperature 
fi = (k-gT)^ 1 . Hereafter we set the Boltzmann constant fee to be unity. 
For small systems, we can obtain the equilibrium value by taking sum 
analytically, on the contrary, it is difficult to obtain the equilibrium value 
for large systems except few solvable models. Then in order to evaluate 
equilibrium value of the physical quantity, we often use the Monte Carlo 
method. 

We consider the Ising model given by 

N 

Wising = -^JijViVj -^hicr*, of = ±l. (26) 

The Ising model without transverse field can be expressed as a diagonal 
matrix by using "trivial" bit representation |f) and \\) which were intro- 
duced in Sec. 2. Then, in this case, we can easily calculate the eigenenergy 
once the eigenstate is specified. 
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We can use the Monte Carlo method for obtaining the equilibrium value 
defined by Eq. (25) as well as the calculation of 7r: 



£ S 0(£)< 



-/3S(£) 



(O) 



(eq) 



(27) 



where 0(E) and E(E) denote the physical value of O and the eigenenergy 
of the eigenstate £, respectively. Here the eigenstate £ is generated by uni- 
form random number and is equal to Monte Carlo step. In the limit 
of infinite Monte Carlo step, LHS of Eq. (27) should be converge to the 
equilibrium value. Equilibrium statistical physics says that the probability 
distribution at equilibrium state can be described by the Boltzmann dis- 
tribution which is proportional to e~ l3E ^' s \ In this case, since we know the 
form of the probability distribution, it is better to use the distribution func- 
tion to generate a state according to the Boltzmann distribution instead of 
uniform random number. This scheme is called importance sampling. When 
we use the importance sampling, we can obtain the equilibrium value as 
follows: 



(O) 



(eq) 



(28) 



In order to generate a state according to the Boltzmann distribution, we 
use the Markov chain Monte Carlo method. Let P(T, a ,t) be the probability 
of the a-th state at time t. In this method, time-evolution of probability 
distribution is given by the master equation: 



P(E a ,t + At) 



^P(£ fe ,i)u;(£ |£ 6 ) + P(E a ,f)u;(E a |E a ) 



^P(E ,i)u;(£ 6 |E ) 



At, 



(29) 



where u>(£ a |£f,) represents the transition probability from the 6-th state to 
the a-th state in unit time. The transition probability iu(£ a |£t>) obeys 



^ W (E a |E b ) = l (VE 6 ). 



(30) 



For convenience, let P(i) be a vector-representation of probability distribu- 
tion {P(£ a ,i)}. Then the master equation can be represented by 



P(t + At) = £P(i), 



(31) 
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where C is the transition matrix whose elements are defined as 



C ba := w(S 6 |S )Ai, 

C aa := 1 - £ ba = 1 - Yl w(E b \H a )At. 



(32) 
(33) 



Here the matrix £ is a non-negative matrix and does not depend on time. 
Then this time-evolution is the Markovian. 

If the transition matrix C is prepared appropriately, which satisfies the 
detailed balance condition and the ergordicity, we can obtain the equi- 
librium probability distribution in the limit of infinite Monte Carlo step 
regardless of choice of the initial state because of the Perron-Frobcnius 
theorem. 

We can perform the Monte Carlo method easily as following process. 

Step 1 We prepare a initial state arbitrary. 
Step 2 We choose a spin randomly. 

Step 3 We calculate the molecular field at the chosen site in Step 2. The 
molecular field at the chosen site i is defined as 



where the summation takes over the nearest neighbor sites of the 
i-th site. 

Step 4 We flip the chosen spin in Step 2 according to a probability defined 
by some way. 

Step 5 We continue from Step 2 to Step 4 until physical quantities such 
as magnetization converge. 

In this Monte Carlo method, we only update the chosen single spin, and thus 
we refer to this method as single-spin-flip method. There is an ambiguity 
how to define u>(£ a |£{,) in Step 4. Here we explain two famous choices 
of u>(£ a |E{,) as follows. Transition probability in the heat-bath method is 
given by 




(34) 




(35) 




Transition probability in the Metropolis method is given by 




(36) 
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Since both two transition probabilities satisfy the detailed balance condi- 
tion, the equilibrium state can be obtained definitely in the limit of infinite 
Monte Carlo step a . It is important to select how to choice the transition 
probability since it is known that a couple of methods can sample states in 
an efficient fashion. 76-83 

So far we considered the Monte Carlo method for systems where there 
is no off-diagonal matrix element. To perform the Monte Carlo method, in 
a precise mathematical sense, we only have to know how to choice the basis 
or appropriate transformation so as to diagonalize the given Hamiltonian. 
However, it is difficult to obtain equilibrium values of physical quantities of 
quantum systems, since we have to calculate the exponential of the given 
Hamiltonian c~@ H in general. If we know all eigenvalues and the corre- 
sponding eigenvectors of the given Hamiltonian, we can easily calculate 
Q-pK by unitary transformation which diagonalizes the Hamiltonian 
H. In contrast, if we do not know all eigenvalues and eigenvectors, we have 
to calculate any power of the Hamiltonian T-L m since the matrix exponential 
is given by 



e A 



oo 1 



m 

m—0 



It is difficult to calculate the matrix exponential in general. Then we have 
to consider the following procedure in order to use the framework of the 
Monte Carlo method for quantum systems. 

In many cases, the Hamiltonian of quantum systems can be represented 



n = n c + n q . (38) 

Hereafter we refer to H c and H q as classical Hamiltonian and quantum 
Hamiltonian, respectively. The classical Hamiltonian T-L c , is a diagonal ma- 
trix. Here we assume that H q can be easily diagonalizcd b . This is a key of 
the quantum Monte Carlo method as will be shown later. Since 7i c and T-L q 
cannot commute in general: [7^ c ,7^ q ] ^ 0, then c _,3W ^ c -f)V. cc -pu^ _ ^ c 



a Recently, the algorithm which does not use the detailed balance condition was pro- 
posed. 76,77 It should be noted that the detailed balance condition is just a necessary 
condition. This novel algorithm is efficient for general spin systems. 

b This fact does not seem to be general. However we can prepare the matrices which can 
be easily diagonalized by the decomposition as Hq = "H q in many cases. 
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decompose the matrix exponential by introducing large integer m, 



exp 







H 



exp 



exp 



——{He + i~L c 

m 



— n c exp H q 

ml \ m 



(39) 



This is a concrete representation of the Trotter formula. 84 From now on, 
we refer to m as Trotter number. By using this relation, we can perform 
the Monte Carlo method for quantum systems. To illustrate it, we con- 
sider the Ising model with longitudinal and transverse magnetic fields. The 
considered Hamiltonian is given as 



N 



N 



H 



E J v°i° z j - E h * a * - r E *t = fie + K 



= 1 
N 



Tic ■= - E Jij^iVj - E hi°i> 



N 

n q :=-r^df 

i=l 



(40) 



(41) 



where optimization problems often can be expressed by this classical Hamil- 
tonian T~i c . The partition function of the Hamiltonian at temperature 
T(= fl^ 1 ) is given by 



Z = Tre 



Using Eq. (39) we obtain 



-/3(H C +W q ) 



(42) 



Z 



lim 

m— ¥00 



E (=1 



si) (si 



e -m c / m 













X • • • 

x (s, 

where represents the direct-product space of N spins: 
|S fc > 



'i,k/ 



>2,ki 



'N.kl i 



(43) 



(44) 



where the first and the second subscripts of |of fe ) indicate coordinates 
of the real space and the Trotter axis, respectively. Here |of fc ) = |t) 
or Equation (42) consists of two elements (£fc|e _,3Wc / m |I]' fe ) and 
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(EJJe ^ q / m |Efc+i). Since the classical Hamiltonian "H c is a diagonal ma- 
trix, the former is easily calculated: 



exp 



N 



Jij a lk a j,k 



E hia ik 



N 



i,k)-> 



(45) 



where a z i k 
calculated as 



±1. On the other hand, the latter (£', 



El 



a -/3W q /m 



- sinh , 

2 V 777 



/ 2/?r 



Efe+i 

N/2 



exp 



J lncoth (§-E<K fe +i 



(46) 



Then the partition function given by Eq. (43) can be represented as 

N 



Z = lim A y exp 



E 

fc=i 



I cr,, h c 



\ 777 



i,k u j,k 



E 



- In coth 



(47) 



where A is just a parameter which does not affect physical quantities. It 
should be noted that the partition function of the d-dimensional Ising model 
with transverse field % is equivalent to that of the (d+ l)-dimcnsional Ising 
model without transverse field JicS which is given by 

N 

Heft 



Nt j 1 Y lib j 

\ ~" \ ~* J ij z z \ " \ "* <H z 

(ij) fc=i i=i fe=i 

^EE? lncoth (^)<fe<fc+i 

1 i=i k=i ^ v 7 



(48) 



The coefficient of the third term of RHS is always negative, and thus the 
interaction along the Trotter axis is always ferromagnetic. This ferromag- 
netic interaction becomes strong as the value of T decreases. This is called 
the Suzuki- Trotter decomposition. 84 ' 85 

So far we explained the Monte Carlo method as a tool for obtaining 
the equilibrium state. However we can also use this method to investigate 
stochastic dynamics of strongly correlated systems, since the Monte Carlo 
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method is originally based on the master equation. In terms of optimization 
problem, our purpose is to obtain the ground state of the given Hamiltonian. 
Then we decrease transverse field gradually and obtain a solution. There 
are many Monte Carlo studies in which the quantum annealing succeeds to 
obtain a better solution than that by the simulated annealing. 5,8 ~ 10, 12,14,86 

3.2. Deterministic Method Based on Mean-Field 
Approximation 

In the previous section, we considered the Monte Carlo method in which 
time-evolution is treated as stochastic dynamics. In this section, on the 
other hand, we explain a deterministic method based on mean-field ap- 
proximation according to Refs. [87,88]. Before we consider the quantum 
annealing based on the mean-field approximation, we treat the Ising model 
with random interactions and site-dependent longitudinal fields given by 

jv 

Hi sing = - J ^ °i °i - hi(j i ■ ( 49 ) 

When the transverse field is absent, the molecular field of the i-th spin is 
given by Eq. (34). Then an equation which determines expectation value of 
the i-th spin at temperature T(= /3" 1 ) is given by 



,(off) 



tanh(/3/4° ff) ). (50) 



e^'-i + e 

In the mean-field level, we approximate that the state crj is equal to the 
expectation value m| in Eq. (34), and we obtain 



(51) 



mf = tanh 

3 

which is often called self-consistent equation. 

We can obtain equilibrium value in the mean-field level by iterating the 
following equation until convergence: 

ml(t + 1) = tanh(/^ cff) (t)), hf\t) = ^ ' ' J l3 m*{t) + h % . (52) 

3 

In order to judge the convergence, we introduce a distance which represents 
difference between the state at t-th step and that at (f +l)-th step as follows: 

1 N 

<*):=^£K(i + l) -mm- (53) 
i=i 
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When the quantity d(t) is less than a given small value (typically ~ 10~ 8 
or more smaller value), we judge that the calculation is converged. We 
summarize this method: 

Step 1 We prepare a initial state arbitrary. 
Step 2 We choose a spin randomly. 

Step 3 We calculate the molecular field given by Eq. (34) at the chosen 
site in Step 2. 

Step 4 We change the value of the chosen spin in Step 2 according to the 

obtained molecular field in Step 3. 
Step 5 Wc continue from Step 2 to Step 4 until the distance d(t) converges 

to small value. 

The differences between the Monte Carlo method and this method are 
Step 4 and Step 5. We can perform the simulated annealing by decreasing 
temperature and using the state obtained in Step 5 as the initial state in 
Step 1 at the time changing temperature . 

Next we explain a quantum version of this method. Here we apply trans- 
verse field as a quantum field. We consider the Hamiltonian given by 

JV N 

n = -J2 J ^ - E h ^ - r E *f ■ ( 54 ) 

i=l i=l 
The density matrix of the equilibrium state is 



exp(-pH) _ En=i exp(-/3e„) |A„) (A n | 



Trexp(-/3#) £Zi exp(-^n) 



(55) 



where e n and |A„) denote the n-th eigenenergy and the corresponding eigen- 
vector. The density matrix satisfies the variational principle that minimizes 
free energy: 



F = min 

p 



Tr(H + p- 1 In p)p , (56) 



where the logarithm of the matrix is defined by the series expansion as well 
as the definition of the matrix exponential (see Eq. (37)). Since it is difficult 
to obtain the density matrix, we have to consider alternative strategy as 
follows. 



c If we want to decrease temperature rapidly, we choose not so small value for judgement 
of convergence. 
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A reduced density matrix is denned as 

Pi ■■= Tr' p = \ (l + mf o z + mf a*) , (57) 

where Tr' indicates trace over spin states except the i-th spin. The values 
mf and mf are calculated by 

mf =Tr (afp), mf = Tr (erf p). (58) 

The reduced density matrix satisfies the following relations: 

Tv(p i ) = l, Tr (of fr) =mf, Ti(ofp i )=mf. (59) 

Here we assume that the density matrix can be represented by direct prod- 
ucts of the reduced density matrices: 

P-l[pu (60) 
i=i 

which is mean-field approximation (in other words, decoupling approxima- 
tion). Then, the free energy is expressed as 

F~minJ-({M), (61) 

N N 

H{pi}) = -Y. J n m i m j - 12 h * m * - r 12 m * 

»=1 *=1 

+/3- 1 ^Tr(p. t lnp 4 )- (62) 
i=i 

From the variation of J~({f>i}) under the normalization condition, we obtain 
the following relations: 

exp(-/37i t ) 

Pi = — > (6o) 

Tr[exp(-/3^)] 

H% ~{ -r h, • vu^j- ^ b4j 

Then the reduced density matrix is represented by using the n-th (n = 1, 2) 
eigenvalues e« and the corresponding eigenvectors | A« ) of "H^ : 

- = cxp(-M°) |Ag) (A^| + cM-^ ] ) |Ag) (A^l 
cxp(-/3 e f ) ) + exp(-/3 e «) 
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We can also obtain the equilibrium values of physical quantities as well as 
the case for T = 0: 

m?(t + l)=T*(0?&(t)), mUt+l)=Tr(a?pi(t)), (66) 
W)= eXp( ~^l (t)) , (67) 

U(t\-(- h *-Zj J V m '® T \ (RR) 

m) ~[ -r +h i + E' j Ji j mi(t))- (68) 

We continue the above self-consistent equation until the following distance 
converges: 

i N 

d ^ ■= ^ E (K(* + !) - <WI + K(* + !) - "*?(*)!) • ( 69 ) 
»=i 

If the temperature is zero, the reduced density matrix should be 

Pi=\X^){X ( t ) \, (70) 

where we consider the case for < e 2 ■ Note that if and only if 
—hi — Yl'j Jij m j = r = 0, = 62 is satisfied. Then if we perform 
the quantum annealing at T = 0, we have to know only the ground state 
of the local Hamiltonian Hi. The procedure is the same as the case for 
finite temperature. By using the method, we can obtain a better solution 
than that obtained by the simulated annealing for some optimization prob- 
lems. Recently, other type of implementation method based on mean-field 
approximation was proposed. 13 The method is a quantum version of the 
variational Bayes inference. 89 We can also obtain a better solution than 
the conventional variational Bayes inference. 



3.3. Real-Time Dynamics 

In Sec. 3.1 and Sec. 3.2, we considered artificial time-development rules 
such as the Markov chain Monte Carlo method and mean-field dynamics. 
In this section, we explain real-time dynamics which is expressed by the 
time-dependent Schrodingcr equation: 

4w*))=#(*)hK*)>> (7i) 



where H(i) and \i(>(t)) denote the time-dependent Hamiltonian and the 
wave function at time t, respectively. The solution of this equation is given 
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by 



\4'{t)) = exp 



H(t)dt 



Hit = o)) 



(72) 



If we use the time-dependent Hamiltonian including time-dependent quan- 
tum field, we can perform the quantum annealing by decreasing the quan- 
tum field gradually. To obtain the solution, it is necessary to decide the 
initial state for Eq. (72). Since our purpose is to obtain the ground state 
of the given Hamiltonian which represents the optimization problem, we 
have no way to know the preferable initial state that leads to the ground 
state definitely in the adiabatic limit. However, in general, we often use a 
"trivial state" as the initial state. Actually, it goes well in many cases. For 
instance, when we consider the Ising model with time-dependent transverse 
field which is given by 

jv 

U(t) = - ]T J^ta] - r(t) £ of, (73) 



we set the ground state for large T as the initial state, hence the initial 
state is set as 



m = o)) = h 

where |— >) denotes the eigenstate of a 1 



|-0 : =_(|t) + |i)). 



(74) 



(75) 



In real-time dynamics, in order to obtain the ground state by using 
given initial condition, it is important whether there is level crossing. If 
there is no level crossing, the system can necessarily reach the ground state 
by the quantum annealing in the adiabatic limit. To show this fact, we first 
consider a single spin system under time-dependent longitudinal magnetic 
field. The Hamiltonian is given by 

-h{t) 
h(t) 

Suppose we set \tp(0)) = \i) as the initial state. For arbitrary sweeping 
schedules, the state at arbitrary positive t is obtained by 



74in g ic(£) = -h(t)a z = 



(76) 



\ip(t)) = exp 



^ / ^single 
10 



(t')dt' 



M0)) = \D 



(77) 



This is because the state \\) is the eigenstate of the instantaneous Hamilto- 
nian for arbitrary time t. In general, when there is a good quantum number 
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Fig. 2. Eigenenergies of the single spin system under longitudinal and transverse mag- 
netic fields for T = 0.5 (left panel) and T = 1 (right panel). The dotted lines represent 
eigenenergies for T = 0. 

and the initial state is set to be the corresponding eigenstate, the good 
quantum number is conserved. Then when we perform the quantum an- 
nealing method based on the real-time dynamics, we should take care of 
the symmetries of the considered Hamiltonian. From this, we can obtain 
the ground state of the considered system in the adiabatic limit if there is 
no level crossing. In practice, however, since we change magnetic field with 
finite speed, a nonadiabatic transition is inevitable. To show this fact, we 
consider a single spin system under longitudinal and transverse magnetic 
fields. The Hamiltonian of this system is given by 

Tangle = -ha' -Ta x =( ~£ ~ F ^ . (78) 

Since the eigenenergies are e± = ±\/h 2 + T 2 , the smallest value of the 
energy difference between the ground state and the excited state is 2r at 
h = as shown in Fig. 2. 

Suppose we consider the single spin system under time-dependent longi- 
tudinal magnetic field and fixed transverse magnetic field. The Hamiltonian 
is given by 

?4ingie(*) - -Kt)a* - Ta x = ( "** ~Q , (79) 

where we adopt h(t) = vt as time-dependent longitudinal field. Here we 
set t = — oo as the initial time. The initial state is set to be the ground 
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state of the Hamiltonian at the initial time \ip(t = — oo)) = \\). The ground 
state at t = +00 in the adiabatic limit is |i/>( ad ) (t = +00)) = ||). Then 
a characteristic value which represents the nature of this dynamics is a 
probability of staying in the ground state at t = +00 which is defined by 

f +00 



stay 



^ (ad) (t = +00) 



exp 



= t 



exp 



^single (t')dt' 



^single (t')dt' 



1p{t = —Oo) 



(80) 



The probability of staying in the ground state should depend on the sweep- 
ing speed v and the characteristic energy gap and can be obtained by the 
Landau-Zener-Stuckclbcrg formula: 90-92 

n(AE) 2 ' 



stay 



1 — exp 



AvAt 



(81) 



where AE and Am represent the energy gap at the avoided level-crossing 
point and the difference of the magnetizations in the adiabatic limit, re- 
spectively. In this case AE = 2T and Am = 2. 

In many cases, typical shape of energy structure can be approximated 
by simple systems such as the single spin system. Then the knowledge of the 
simple transitions such as the Landau-Zcner-Stiikelberg transition and the 
Rosen- Zener transition 93 is useful to analyze the efficiency of the quantum 
annealing based on the real-time dynamics. 



3.4. Experiments 

Transverse field response of the Ising model has been also established in 
experimentally. 94-103 A dipolar-coupled disordered magnet LiHo a; Yi_ a ;F4 
has easy-axis anisotropy and can be represented by the Ising model. 104,105 
If we apply the longitudinal magnetic field (in other words, the magnetic 
field is parallel to the easy-axis), phase transition does not take place. 106 ' 107 
However, when we apply the transverse magnetic field (in other words, the 
magnetic field is perpendicular to the easy- axis), phase transitions occur 
and interesting dynamical properties shown in Rcf. [ 6] were observed. In the 
phase diagram of this material, there are three phases. The ferromagnetic 
phase appears at intermediate temperature and low transverse magnetic 
field, whereas at low temperature and low transverse magnetic field, the 
glassy critical phase 108 appears. The paramagnetic phase exists at the other 
region. The glassy critical phase exhibits slow relaxation in general. It found 
that the characteristic relaxation time obtained by ac field susceptibility for 
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quantum cooling in which we decrease transverse field after temperature is 
decreased is lower than that for temperature cooling case. 6 From this result, 
it has been expected that the effect of the quantum fluctuation helps us to 
obtain the best solution of the optimization problem. 



4. Optimization Problems 

Optimization problems are defined by composition elements of the con- 
sidered problem and real- valued cost/gain function. They are problems to 
obtain the best solution such that the cost/gain function takes the min- 
imum/maximum value. In general, the number of candidate solutions in- 
creases exponentially with the number of composition elements in optimiza- 
tion problems. Although we can obtain the best solution by a brute force in 
principle, it is difficult to obtain the best solution by such a naive method 
in practice. Then we have to invent an innovative method for obtaining 
the best solution in a practical time and limited computational resource. 
Optimization problems can be expressed by the Ising model in many cases. 
Once optimization problems are mapped onto the Ising model, we can use 
methods that have been considered in statistical physics and computational 
physics such as the quantum annealing. 

In the anterior half of this section, we explain the correspondence be- 
tween the Ising model and the traveling salesman problem which is one 
of famous optimization problems. We demonstrate the quantum annealing 
based on the quantum Monte Carlo simulation for this problem. In the pos- 
terior half, we explain the clustering problem as the example expressed by 
the Potts model which is a straightforward extension of the Ising model. 



4.1. Traveling Salesman Problem 

In this section, we consider the traveling salesman problem which is one of 
famous optimization problems. The setup of the traveling salesman problem 
is as follows: 

• There are N cities. 

• We move from the i-th city to the j-th city where the distance 
between them is £ij. 

• We can pass through a city only once. 

• We return the initial city after we pass through all the cities. 
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The traveling salesman problem is to find the minimum path under above 
conditions. The length of a path is given by 

N 

L ~J2 e oa,c a+ „ (82) 

£1=1 

where c a denotes the city where we pass through at the a-th step. In the 
traveling salesman problem, the length of a path is a cost function. From 
the fourth condition, the following relation should be satisfied: 

cjv+i = ex. (83) 

In terms of mathematics, the traveling salesman problem is to find {c a }a=i 
so as to minimize the path L under the above four conditions. 

If the number of cities N is small, it is easy to obtain the shortest path 
by a brute force. We can easily find the best solution of the traveling sales- 
man problem for N = 6 shown in Fig. 3. Figure 3 (a) and (b) represent a 
bad solution and the best solution where the length of the path L is mini- 
mum, respectively. As the number of cities increases, the traveling salesman 
problem becomes seriously difficult since the number of candidate solutions 
is (N — l)!/2. Then if we want to deal with the traveling salesman problem 
with large N, we have to adopt smart and easy practical methods such as 
the simulated annealing instead of a brute force. To use the simulated an- 
nealing, we map the traveling salesman problem onto the Ising model with 
a couple of constraints as follows. 

We consider N x N two-dimensional lattice. Let n^ a be the microscopic 
state which represents the state at the i-th city at the a-th step. The value 
of n.^ a can be taken either or 1. If we pass through the i-th city at the 




Fig. 3. Traveling salesman problem for N = 6. Thin lines and thick lines denote the 
permitted paths and selected paths, respectively, (a) Bad solution, (b) The best solution 
in which the length of the path is minimum. 
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a-th step, n^a is unity whereas n^ a = if we do not pass through the i-th 
city at the a-th step. The third condition can be represented by 

N 

^n,, a = l (forVi). (84) 

a=l 

Furthermore, since it is obvious that we can pass through only one city at 
the a-th step, this constraint is expressed by 

N 

J2ni, a = l (forVa). (85) 

i=l 

Then the length of the path L can be rewritten as 

N N 

L = J2Y2 ki n i,a. n i,a+l = 1 Yl kj<Ti,a<rj,a+l + COnst '' ( 86 ) 
a—1 i.j a—1 i.j 

where the Ising spin variable erf a = ±1 is defined by 

at a := 2n,, a - 1. (87) 
Here wc used the following relation derived by Eqs. (84) and (85): 

N 

const. (88) 

o=l i,j 

Then the length of the path can be represented by the Ising spin Hamilto- 
nian on N x N two-dimensional lattice. In general, it is difficult to obtain 
the stable state of the Ising model with some constraints regarded as some 
kind of frustration which will be shown in Sec. 5.2. 



4.1.1. Monte Carlo Method 

We explain how to implement the Monte Carlo method in the traveling 
salesman problem. We cannot use the single-spin-flip method which was ex- 
plained in Sec. 3.1 because of existence of two constraints given by Eqs. (84) 
and (85). The simplest way of transition between states is realized by flip- 
ping four spins simultaneously as shown in Fig. 4. 

Suppose we consider the case that we pass through at the i-th city at 
the a-th step and pass through at the j-th city at the a'-th step, which is 
described as 



°i,a = + 1 ! a j.a = 



-!> a i,a' = 



-1, G Z ha , = +1. 



(89) 
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(b) 

1 2 3 4 5 6 
• O O O O O 
O O O O O • 
O O O O • O 
O • O O O O 
O O • O O O 

loooioo 

step 



Fig. 4. The simplest way of flipping method in traveling salesman problem. Transition 
between the state depicted in (a) and that depicted in (b) occurs. In this case, i = 3, 
j = 6, a = 2, and a' = 5. 

The trial state generated by flipping four spins is as follows: 

<a = -1= °j, a = + 1 ' <a< = +1. = (9°) 

The heat-bath method and the Metropolis method can be adopted for the 
transition probability between the present state and the trial state. In Fig. 4, 
i = 3, j = 6, a = 2, and a' = 5. 

It should be noted that without loss of generality the initial condition 
can be set as 

*1,1=+1, «7i,l = -l (i^l), (91) 

and thus we can fix the states at the first step (a = 1) during calculation. 
The number of interactions in which we try to flip all spins in each Monte 
Carlo step is (N - l)(N - 2)/2. 




1 2 3 4 5 6 

• O O O O O 

O O • O O O 

O O O O • O 

O • O O O O 

o o o o o • 

o o o • o o 

step 



4.1.2. Quantum Annealing 

In order to perform the quantum annealing, we introduce the transverse 
field as the quantum fluctuation effect as shown in Sec. 3. The quantum 
Hamiltonian is given by 

N N N 

* = I E E kiKa°la + l -r£E^a, (92) 
a—1 i,j a—1 i—1 

where the first-term corresponds to the length of path and the second-term 
denotes the transverse field. We can map this quantum Hamiltonian on N x 
N two-dimensional lattice onto N x N x m three-dimensional Ising model 
as well as the case which was considered in Sec. 3.1. The effective classical 
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Hamiltonian derived by the Suzuki- Trotter decomposition is written as 



^ N rn 
HcS = 4^ H 2~I 2~I **J°iU I k°J > «H-l,A 



a=l ij fc=l 
N N m 



^J212J2 ilncoth f-^ J CT< j0jfc CT? 0)fc+1 , ct? 0)A . = ±1. (93) 

" o=l i=l fc=l 



In the quantum annealing procedure, we have to take care of the constraints 
given by Eqs. (84) and (85) as stated before. Then the simplest way of 
changing state is to flip simultaneously four spins on the same layer (m is 
fixed) along the Trotter axis. 



4.1.3. Comparison with Simulated Annealing and Quantum 
Annealing 

In order to demonstrate the comparison with the simulated annealing and 
the quantum annealing, we perform the Monte Carlo simulation for the 
traveling salesman problem. As an example, we consider TV = 20 cities de- 
picted in Fig. 5 (a). The positions of these cities were generated by pair 
of uniform random numbers (0 < Xi,yi < 1). The time schedules of tem- 
perature T(t) for the simulated annealing and transverse field T(t) for the 




0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 



Fig. 5. Traveling salesman problem for N = 20. (a) Positions of cities, (b) The best 
solution in which the length of the path is minimum. 
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quantum annealing arc defined as 



T(t) := T a + Ti 



r(t) :=r + r! 




(94) 



(95) 



where T and T are temperature and transverse field at the final time 
(t = r), and To + T\ and To + Ti are temperature and transverse field at 
the initial time (t = 0). The value of r _1 indicates the annealing speed, 
and the annealing speed becomes slow as the value of r increases. In our 
simulations, we adopt To = Tq = 0.01 and T = T\ = 5. Furthermore, we 
fix the transverse field as T — during the simulation in the simulated 
annealing and the temperature as T = 0.01 during the simulation in the 
quantum annealing. 

We execute 100 independent simulations of simulated annealing based 
on the heat-bath type Monte Carlo method where each initial state gener- 
ated by the uniform random number is different. To compare the efficiency 
of the simulated annealing and quantum annealing in an equitable manner, 
in the quantum annealing, the Trotter number is putted as m = 10, and we 
execute 10 independent simulations. We also calculate the minimum length 
of path L m j n (i) := min{L(t')|0 <t'< t}. It should be noted that L m - in (t) 
is a monotonic decreasing function. The upper panel of Fig. 6 shows the 
time dependence of minimum length of path L m i n (t) for various r. From the 
upper panel of Fig. 6, we can see that the convergence of minimum length 
of path in the quantum annealing is faster than that in the simulated an- 
nealing. We also show the sweeping time r dependence of the minimum 
length of path at the final state L m i n (r) in the lower panel of Fig. 6. This 
figure indicates that the obtained solution in the quantum annealing is al- 
ways better than that in the simulated annealing. Figure 5 (b) shows the 
obtained best solution in both the simulated annealing and the quantum 
annealing with slow schedule. 

In this way, we can obtain a better solution (in this case, the best 
solution) by both annealing methods with slow schedule. Moreover, in our 
calculation, the convergence of solution in the quantum annealing is faster 
than that in the simulated annealing, and the obtained solution in the 
quantum annealing is better than that in the simulated annealing regardless 
of sweeping time r. Thus, we can say that the quantum annealing method 
is appropriate as the annealing method for the traveling salesman problem 
in comparison with the simulated annealing. This fact has been confirmed 
in some researches. 86,109 
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Fig. 6. (Upper panel) Time dependence of minimum length of path L m i n (t) for r = 10, 
100, and 1000 obtained by the simulated annealing (SA) and the quantum annealing 
(QA). (Lower panel) Sweeping-time r dependence of minimum length of path at the 
final state L m [ n (T) obtained by the simulated annealing indicated by squares and the 
quantum annealing indicated by circles. 



4.2. Clustering Problem 

In Sec. 4.1, we explained the traveling salesman problem which can be 
mapped onto the Ising model with some constraints. Many optimization 
problems can also be mapped onto the Ising model. However, there are a 
number of optimization problems that can be described by the other models 
which are straightforward extensions of the Ising model. In this section, we 
review the concept of clustering problem as such an example. 

Clustering problem is also one of important optimization problems in 
information science and engineering. 12-14 We need to categorize much data 
in the real world according to its contents in various situations. For in- 
stance, suppose we play stock market. In order to see the socioeconomic 
situation, we want to extract efficiently important information related to 
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stock market from an enormous quantity of information in news sites and 
newspapers. In this case, it is better to categorize many articles in news 
sites and newspapers according to their contents. This is an example of 
clustering problem which is adopted for many applications in wide area of 
science such as cognitive science, social science, and psychology. The clus- 
tering problem is to divide the whole set into a couple of subsets. Here we 
refer to the subsets as "cluster" . 

Figure 7 shows schematic picture of the clustering problem. Suppose we 
consider much data in the whole set which represents the square frame in 
Fig. 7 (a). The points in Fig. 7 denote individual data. In the clustering 
problem, our target is to find which the best division is. Figure 7 (b), (c), 
and (d) represent typical clustering states Si, £2, and S„, respectively. 
The states Si and S2 are an unstable solution and a metastable solution, 
respectively. The state S* denotes the best solution of clustering problem. 

In order to consider how to implement the quantum annealing, the clus- 
tering problem can be described by the Potts model with random interac- 




(b) 



(c) 



(d) 



Fig. 7. Schematic pictures of clustering problem. The points represent data and the 
square denote the whole set. (a) Data set. (b) Unstable solution Ei. (c) Metastable 
solution E2. (d) The best solution E*. 
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tions d . The Hamiltonian of the Potts model is given by 



%Pott8 — — JijS a 



Ol = 1, 



31 



(96) 



'■,/ 



where the summation runs over all pairs of the i-th and j-th data. The spin 
variable <Xj represents individual data. Here the value of Q represents the 
number of clusters. When cr, = (Xj, the i-th and j-th data are in the same 
cluster. It is natural to adopt ferromagnetic/antiferromagnetic interaction 
between data in the same/different cluster. It should be noted that the 
Potts model is a straightforward extension of the Ising model since the 
Potts model is equivalent to the Ising model if Q = 2. Then the clustering 
problem is a problem to obtain the ground state of the Hamiltonian of 
the Potts model with given random interactions. Here we assume that the 
number of clusters is fixed. 

Next we explain how to introduce quantum field in order to perform the 
quantum annealing. In optimization problems which can be represented by 
the Ising model, we can use transverse field as the quantum fluctuation 
which is represented as — Tj^i °f ■ However, we cannot use this transverse 
field — r af for the clustering problem directly, since the matrix which 
represents the state is Q x Q matrix. Thus, we generalize the x-component 
of the Pauli matrix of the Ising model as follows: 



Er 



( -1-1... -\\ 
-1 -1 ■ ■ • -1 

-1-10 : -1 



V-l -1 -1 ••• / 



(97) 



where Eq and Iq represent the Q x Q unit matrix and the Q x Q matrix 
whose all elements are unity. By using this generalized Pauli matrix, we can 
apply the quantum annealing for clustering problem. 12-1 Here we consider 
the following Hamiltonian: 



N 



n = n Po tt s + n^ otts \ 



nj (Potts) 
rtq 



i=l 



(98) 



d In practice, we do not know {Jij} and have to estimate interactions when we consider 
the clustering problem. However, we assume the Hamiltonian for simple explanation. As 
shown in this section, the implementation method does not depend on the specific form 
of interactions. 
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where N is the number of individual data. As well as the case for the Ising 
model, we can calculate the partition function of the Hamiltonian: 

s +7i< Pott8) ) 



Z P , 



s =Tre" 
= lim 



-en 



E 

{S fc },{S^} 



-/Sfipotts/TO 



x < E 



-/SWpotta/m 



^4 



E „, ) ( E„- 



E 

si) (si 



-pK 



ta > /m 



-pK 



>/m 



Ei 



where |Ej.) represents the direct-product space of -/V spins: 
|E fc ) = |(7 1)fc ) ® |o-a lfc ) ® • ■ ■ |<7jv,fc> • 



(99) 



(100) 



There are two elements (E fe | e - /3 ' ftp ° tt */ m |E' fe ) and (£ye _ ^4° /m |E fc+ i) 
These factors are calculated as follows: 



Ei 



exp I ^E 



I^, fe ,^ fe! (101) 



E' 



-PK 



tB '/m 



Jfc+1 



n 



i=l L 



C ™ 0„/ 



ilfc <r (l *+i T Q ^ 



(i-O) 



(102) 



By using the above expressions, we can perform the quantum Monte Carlo 
simulation as well as the Ising model with transverse field. If the spin vari- 
able is not 5 = 1/2 Ising spin as in the case just described, we can im- 
plement the quantum annealing by considering appropriate quantum field. 
There are some studies that the quantum annealing succeeds to obtain the 
better solution than the simulated annealing for clustering problems. 12-14 



5. Relationship between Quantum Annealing and 
Statistical Physics 

In the preceding sections we explained the Ising model, a couple of imple- 
mentation methods of the quantum annealing, and the optimization prob- 
lems. There are a couple of studies that clarify the efficiency and feature 
of the quantum annealing in terms of statistical physics. In this section we 
take two examples which display relationship between quantum annealing 
and statistical physics focusing on the thermal fluctuation effect and the 
quantum fluctuation effect for ordering phenomena. In the first half, we 
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review the Kibble-Zurck mechanism which characterizes the efficiency of 
the quantum annealing for systems where a second-order phase transition 
occurs comparing with the efficiency of the simulated annealing. In the last 
half, we show similarities and differences between thermal fluctuation and 
quantum fluctuation for frustrated Ising spin systems. 



5.1. Kibble-Zurek Mechanism 

In statistical physics, it has been an important topic to investigate the 
ordering process in systems where a phase transition takes place. 110-1 16 
Especially, dynamical properties during changing control variables such 
as temperature and external fields are interesting. 111 ' 113,115 Recently, the 
Kibble-Zurek mechanism has been drawing attention not only in statistical 
physics and condensed matter physics but also for the quantum anneal- 
ing. In this section, we explain the Kibble-Zurek mechanism relating to a 
dynamics which passes across a second-order phase transition point. The 
Kibble-Zurek mechanism can make clear what happens in systems where 
the second-order phase transition occurs during the simulated annealing 
and the quantum annealing from a viewpoint of statistical physics. Before 
we consider the efficiency of the quantum annealing comparing with the 
simulated annealing by using the Kibble-Zurek mechanism, we show the 
general feature of the Kibble-Zurek mechanism. 

As an example, we consider the Kibble-Zurek mechanism in the fer- 
romagnetic system where the second-order phase transition occurs at fi- 
nite temperature. At the second-order phase transition point, the correla- 
tion length diverges in the equilibrium state, and thus the relaxation time 
should be infinite. Hence, the system cannot reach the equilibrium state, 
when we decrease temperature to the transition temperature with finite 
speed. Furthermore, since the relaxation time is long around the transition 
temperature, it is difficult to equilibrate the system. Here, we assume that 
growth of correlation length stops at the temperature where the system is 
less able to reach the equilibrium state. If we decrease temperature slow 
enough, the system can reach the equilibrium state even near the transi- 
tion point. Thus, it is expected that the value of stopped correlation length 
because of the long relaxation time depends on the annealing speed. As we 
will see below, the value of stopped correlation length can be scaled by the 
annealing speed. 

To consider the second-order phase transition at finite temperature in 
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the ferromagnetic systems, we define the dimensionlcss temperature g as 

T — T 

.9:=^A (103) 

^ c 

where T c is the phase transition temperature. When the absolute value of g 
is small, it is believed that the scaling ansatz is valid. By the scaling ansatz, 
the temperature-dependent correlation length £(g) is given as 117 

tt9) cc \g\~ v , (104) 

where v is one of the critical exponents. Moreover, the relaxation time T re i 
is scaled by the following relation: 117 

TreiG?) « [i{g)] z cx \g\~* v , (105) 

where z is the dynamical critical exponent. Here, we decrease the temper- 
ature T(t) against the time t as following schedule: 

T(t) =T c (l- -0 (-cm < t < tq). (106) 

The value of Tq 1 corresponds to the annealing speed. When the value of tq 
is large/small, the system is annealed to low temperature slowly/quickly. 
At t = 0, the temperature is the phase transition temperature (T(0) = 
T c ), and the temperature is zero (T(tq) = 0) at t = tq. From Eq. (106), 
the dimensionless temperature g becomes the time-dependent function as 
follows: 

9(f > _ _ _±. (107) 

In the Kibble-Zurek mechanism, we assume the following situation: 

!T IC \(g(t)) < \t\ : system can reach equilibrium state (108) 
Tiei(g(t)) > \t\ : system cannot reach equilibrium state 

where |i| is a remaining time to transition temperature. That is, when a 
remaining time \t\ is longer/shorter than the relaxation time T Ie i(g(t)), the 
system can/cannot reach the equilibrium state. Note that the value of con- 
sidered t should be negative since the relaxation time diverges before the 
temperature reaches the transition temperature (t = 0). From this assump- 
tion, the time t at which the system is less able to reach the equilibrium 
state is defined by following relation: 



r rel (<?(*)) = \t\. 



(109) 
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Furthermore, since we have assumed that the growth of correlation length 
stops at t = t , the value of correlation length is always £(g(t)) below T(t) as 
shown in Fig. 8. Moreover, the dimensionless temperature at t is expressed 
as 



gi t) = E. = 



(g(i)) qc \g(t)\- 



(110) 



From this relation, g(t) is scaled by the annealing speed, and from Eqs. (104) 
and (110), the correlation length at t = t is scaled as follows: 



g{t)^T Q ^\ £{g{i))KT^. 
Furthermore, the density of domain wall n(t) is written as 

n{t) cx Z{g(t))- d , 



(111) 



(112) 



where d is the spatial dimension, and nit) at t = t is scaled as follows: 

(H3) 

For instance, in the ferromagnetic Ising model on two-dimensional lattice 
(d = 2, v = 1) when we adopt the Monte Carlo dynamics based on the 
single-spin-flip method (z = 2. 132), 118 the correlation length and the den- 
sity of domain wall at t = t are naively obtained as 

£(ff(t)) (X r°' 319 , nit) cx r- - 639 . (114) 

In this way, in the dynamics which passes across the second-order phase 
transition point at finite temperature, the correlation length and the den- 
sity of domain wall (topological defect) are scaled by the annealing speed. 




T, 



T Q 2 



To 



■T 



-T 



Fig. 8. Schematic of the annealing speed dependence of correlation length £(g(t)). Tq 1 
is annealing speed and tq ± > tq 2 > t"q 3 - We define T; := T c (l + 141/tqj) and £j : = 
£(l*l/ r Q ■)■ ^ ne dotted curve represents correlation length in the equilibrium state. 
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This argument is called the Kibble-Zurek mechanism. Since the Kibblc- 
Zurek mechanism explains the creation of topological defects induced by 
cooling of the system which takes place the second-order phase transition, 
this relates to the evolution of cosmic strings by spontaneous symmetry 
breaking in the Big Bang theory. 119-121 The Kibble-Zurek mechanism can 
also describe the creation of topological defects in magnetic models, 122,123 
supcrfluid helium systems, 124 ' 125 and Bose-Einstein condensations. 126,127 
Next we consider the efficiency of the simulated annealing and the quan- 
tum annealing using the Kibble-Zurek mechanism by taking examples which 
can be treated analytically. 

5.1.1. Efficiency of Simulated Annealing and Quantum Annealing 

Next, we consider the efficiency of the simulated annealing and the quantum 
annealing according to the Kibble-Zurek mechanism. As an example, we 
treat the case where the non-domain wall state is the best solution. In this 
case, the value of n(t) approximately represents the difference between the 
obtained solution and the best solution. Thus, by using the Kibble-Zurek 
mechanism, we can compare the efficiency of annealing methods from the 
behavior of nit) against the annealing speed. Suppose we solve optimization 
problems by using annealing methods, we would like to obtain a better 
solution as fast as possible, in other words, as small tq as possible. Then, 
the comparison obtained by the Kibble-Zurek mechanism is expected to 
become an useful information for the optimization problems. 

As an example, we consider the efficiency of the simulated annealing 
and the quantum annealing for the random ferromagnetic Ising chain in 
terms of the Kibble-Zurek mechanism according to Refs. [128,129]. 

5.1.2. Simulated Annealing for Random Ferromagnetic Ising Chain 

The model Hamiltonian of the random ferromagnetic Ising chain is given 
as 



where Ji is the interaction between the z-th site and the (i + l)-th site. The 
value of Ji is given by the uniform distribution between < Ji < 1. The 
distribution function P( u )(Jj) is given by 




(115) 




otherwise 



for < Ji < 1 



(116) 
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Since the interaction Jj is always positive value, the ground state spin 
configuration is the all-up spin state or the all-down spin state. In this 
model, the ferromagnetic transition occurs at zero temperature. 

The correlation function between two sites where the distance is r is 
written as 

[((Ticri + r)]a,v = (jj In cosh P J , (117) 

where (• • • ) and [• • • ] av denote the thermal average and the random average. 
Physical quantities should depend on the specific spatial pattern of the 
random interactions {Ji}. Then, these averages are defined by 

[0({J,:})]av := J HdJiP^WOttJi}), (119) 

i 

respectively. We omit the argument {{Ji}) for simplicity. The relationship 
between the correlation function and the correlation length £ is given by 

[(^cr i+r )] av = c- r/ «. (120) 

Here we mainly focus on the low-temperature limit, since the correlation 
length grows as temperature decreases. Then the correlation length is given 
as 

e= I ~ A (m) 

^ ln^- 1 In cosh P) In 2' y ' 

Here, we adopt the Glauber dynamics 130 as the time development, and thus 
the relaxation time r re i can be written as 

lcl_ l-tanh2/3 " 2° ~ 2 & ' 

As we can see, in this model, the correlation length ^ and the relaxation 
time T re i are not the power function of temperature unlike the case of the 
systems where the second-order phase transition occurs at finite tempera- 
ture (Eqs. (104) and (105)). This is because properties are different between 
phase transition which exhibits at finite temperature and that occurs at zero 
temperature. 

We decrease temperature T(t) against the time t as following schedule: 
T(t) = — - (-00 < t < 0). (123) 
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Here T c = in this system. According to the Kibblc-Zurek mechanism, we 
define t by following relation: 

r Iel (T(t)) = \t\, (124) 

and, we obtain 

Tit) = i = T^m. (125) 

By using Eqs. (121) and (122), low-temperature limit of Eq. (125) is written 
as 

1 1 



£(T(*))]n2 2r Q 

and, we obtain 



e 4€(T(t))ln 2) (126) 



t (T (K _ lnr Q + ln2-ln(C(T(f))ln2) lnr Q 
U 41n2 %y' 10 

The approximation of RHS is valid in the case of tq 3> 1 which indicates 
very slow annealing speed. Thus, we can estimate the density of domain 
wall nsA(t) at t = t as follows: 

41n2 , 
n SA (t) cx . (128) 

lUTQ 

5.1.3. Quantum Annealing for Random Ferromagnetic Ising Chain 

We study the Kibble-Zurek mechanism for the random ferromagnetic Ising 
chain with transverse field T. The model Hamiltonian is given as 

«=-x; j i^i- r E s f' ( i2Q ) 

i i 

where the value of Ji is given by the uniform distribution between < 
Ji < 1 as well as the case of simulated annealing. In this model, the quan- 
tum phase transition from the paramagnetic phase to the ferromagnetic 
phase occurs at T c = cxpQln Ji] av ). 131 Here, we define the dimensionless 
transverse field g as 

9 ■= (130) 

1 c 

When \g\ <C 1, it has been known that the correlation length obtained by 
the renormalization group analysis 132 is scaled by the following relation: 

Z{g)<x\9\- V 0^ = 2). (131) 
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Moreover, a coherence time r co h is scaled by 

TcohQ?) « ia(g)} z « \g\- v ' (y = 2), (132) 

where the dynamical exponent z is scaled as 

zcx|i|, (133) 

which is also obtained by the renormalization group analysis. 132 This means 
that the dynamical exponent diverges at the transition point, and this be- 
havior is a qualitative difference between the random system and the pure 
system (z = 1). From this fact, r co h cannot be expressed by the power 
function of g unlike the case of the second-order phase transition at finite 
temperature. 

We decrease transverse held T(t) against the time t as following schedule: 

T(t)=T c (l- -^J (-oo<f<r Q ). (134) 

According to the Kibble-Zurek mechanism, we define t by following relation: 

TcohG?(t)) = |*|, (135) 

and we obtain 

g(t) = M = T «*(g(*» (136) 

TQ TQ 

By using Eqs. (131), (132), and (133), Eq. (136) is written as 



cx -\am)\ z « — leGrt*))!^^, (137) 



and, we obtain 



(\/W)) + 5)lnW))ocl n r Q . (138) 
In the limit of tq 3> 1, since the value of £(<?(?)) is very large, 



2 

and we obtain 133 



\/((g(m + 3 = vW")). ( 139 > 
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Moreover, since the change of ln£(g(i)) is gradual in comparison with that 
of £(<?(£)), we neglect In £(<?(?)) and obtain 

£(«?(?)) (X (lnr Q ) 2 . (141) 

From this relation, we can estimate the density of domain wall 71qa(£) at 
t = t as follows: 

n QA {t) cx (lnr Q )~ 2 . (142) 

5.1.4. Comparison between Simulated and Quantum Annealing 
Methods 

We have shown analysis of the domain wall density in the random ferromag- 
netic Ising chain during the simulated annealing and the quantum annealing 
by the Kibble-Zurck mechanism. The obtained densities of domain wall are 

nsA(i) ex. (Iiltq) 1 : simulated annealing, (143) 

nQA(t) <x (lnrQ) 2 : quantum annealing. (144) 

From these relations, it is clear that the decay of 7iqa(0 is faster than that 
of 71sa(£) against the value of tq. Thus, from the Kibble-Zurek mechanism, 
it is concluded that the quantum annealing method is appropriate as the 
annealing method for the random ferromagnetic Ising chain in comparison 
with the simulated annealing method. Suppose we consider the ferromag- 
netic Ising chain with homogeneous interaction (Jj = 1 for all i). In this 
case, both the domain wall density in the simulated annealing and that in 
the quantum annealing are obtained as 

n(t) cx . (145) 



This relation for the simulated annealing can be obtained by a simple cal- 
culation as well as the case of the random Ising spin chain. On top of that, 
the relation for the quantum annealing can be derived by Eq. (113). Here 
the critical exponent v of the transverse Ising chain with homogeneous in- 
teraction is v = 1 and the dynamical exponent of this system is z = 1. 
Then there is no difference between the simulated annealing and the quan- 
tum annealing in the case of the homogeneous ferromagnetic Ising chain. 
However, since the optimization problem has some kind of randomness, the 
abovementioned result encourages that the quantum annealing is better 
than the simulated annealing for optimization problems. 

In general, the existence of the phase transition in optimization prob- 
lems negatively influences performance of annealing methods. Here, we have 



March 2, 2013 16:33 



WSPC - Proceedings Trim Size: 9in x 6in Tanaka'KLN'main 



41 

introduced the Kibblc-Zurck mechanism relating to the dynamics which 
passes across the second-order phase transition point. As the specific ex- 
ample, we have analyzed the efficiencies of the simulated annealing and the 
quantum annealing for the random ferromagnetic Ising chain according to 
the Kibble-Zurek mechanism. For this model, the efficiency of the quan- 
tum annealing is better than that of the simulated annealing. Of course, 
since the efficiency of annealing methods depends on the details of opti- 
mization problems, it is not to say that the quantum annealing is always 
appropriate as the annealing method for general optimization problems in 
comparison with the simulated annealing. Moreover, we have to develop a 
theory based on the Kibblc-Zurck mechanism itself, 134 since we assume the 
growth of the correlation length stops at t > t . For example, if we adapt 
the Kibble-Zurek mechanism to two- or three-dimensional models and more 
complicated models, it is difficult to estimate the correlation length analyt- 
ically, and thus we should execute numerical simulations such as the Monte 
Carlo simulation. For example, in the two-dimensional Ising model with 
random interactions, it has been shown that the efficiency of the quantum 
annealing is better than that of the simulated annealing by Monte Carlo 
simulation. 129 Although the efficiency of annealing methods for a number of 
optimization problems has been clarified by the Kibble-Zurek mechanism, 
it remains to be an open problem to investigate when to use the quantum 
annealing exhaustively. 

In the above-mentioned argument, the phase transition under consider- 
ation is of the second order. What happens if we adapt the same argument 
for the other type phase transitions such as first-order phase transition and 
Kosterlitz-Thouless (KT) transition? In these phase transitions, the behav- 
iors of correlation length arc different from that in systems where a second- 
order phase transition occurs: the finite-correlation length at the first-order 
phase transition point and the quasi-long-range correlation length at the 
KT transition point. Thus, it is an interesting problem to clarify relationship 
between behaviors of correlation length and the generalized Kibblc-Zurck 
mechanism. By considering dynamical nature of the optimization problems 
in terms of non-equilibrium statistical physics in a deeper way, we believe 
that the quantum annealing method will become a central part of practical 
method for optimization problems. 
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5.2. Frustration Effects for Simulated Annealing and 
Quantum Annealing 

In many cases optimization problems can be represented by the Ising model 
with random interactions and magnetic fields as mentioned before. The 
Hamiltonian of this system is given by 

N 

n = - E J «<°i - E fc * ' °i = ±L ( 146 ) 

i,j i=l 

When all interactions are ferromagnetic as the previous example in Sec. 5.1, 
the ground state is the all-up or the all-down states. However, if there are 
antifcrromagnetic interactions in the system, the situation becomes differ- 
ent. In order to show the difference between ferromagnetic interaction and 
antifcrromagnetic interaction, we first consider three spin system on trian- 
gle cluster as shown in Fig. 9. In this section, we treat the case for hi = 
for all i. The dotted and solid lines in Fig. 9 represent ferromagnetic and 
antifcrromagnetic interactions, respectively. 
The considered Hamiltonian is written as 

^triangle = ~ J«fj| + fjf o| + fjfof). (147) 

Here we set the all interactions are the same value for simplicity. The ground 
states for positive J (ferromagnetic interaction) are the all-up or the all- 
down states shown in Fig. 9 (a). In these states, all spins between all inter- 
actions are energetically favorable states. In the case of negative J (antifcr- 
romagnetic interaction), while on the other hand, six states shown in Fig. 9 
(b) are ground states. These ground states have unfavorable interactions 

(a) Q 
O O 




AAA 



Fig. 9. Three spin system on triangle cluster. The dotted and solid lines represent 
ferromagnetic and antifcrromagnetic interactions, respectively. The open and solid circles 
are the +l-state and the — 1-state, respectively. The crosses indicate the positions of 
unfavorable interactions, (a) Ground states for ferromagnetic case, (b) Ground states for 
antifcrromagnetic case. 
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indicated by the crosses in Fig. 9 (b). This situation is called frustration. In 
the homogeneous antiferromagnetic Ising spin systems on lattices based on 
triangle such as triangular lattice and kagome lattice, frustration appears 
in all triangles. Since such frustration comes from lattice geometry, this is 
called geometrical frustration. It should be noted that the homogeneous an- 
tiferromagnetic Ising spin systems on square lattice and hexagonal lattice 
have no frustration. Since these systems are bipartite systems which can be 
decomposed by two sublattices, these systems can be transformed on the 
ferromagnetic systems by local gauge transformation of all spins belonging 
to one of the sublattices. 

Frustration appears in also inhomogeneous systems as shown in Fig. 10. 
The squares pointed by stars in Fig. 10 represent frustration plaqucttes 
which are satisfied following relation: 

«* : = II J ^ < °> ( 148 ) 

where indicates the smallest square plaquette at the position k. If 
for all k is positive, the system is not frustrated. 

In general, frustration prevents the system from conventional magnetic 
ordering such as ferromagnetic order and Neel order, since there is no state 
where all interactions are satisfied energetically in frustrated systems. Frus- 
tration makes peculiar density of states which induces unconventional phase 
transition and slow dynamics. 112,115,135-144 Although many optimization 
problems can be represented by the Ising model with random interactions 
and magnetic fields, here we focus on the frustration effect which comes 




Fig. 10. A ground state of the Ising spin system with random interactions. The dotted 
and solid lines represent ferromagnetic and antiferromagnetic interactions, respectively. 
The open and solid circles are the +l-state and the — 1-state, respectively. The stars and 
crosses indicate frustration plaqucttes and unfavorable interactions, respectively. 
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from non-random interactions. In terms of statistical physics, this is a first- 
step study to investigate similarities and differences between thermal fluc- 
tuation and quantum fluctuation for frustrated systems. Furthermore, it is 
important topic for the optimization problems to consider the thermal fluc- 
tuation and quantum fluctuation effects for frustrated systems. To obtain 
the ground state of frustrated systems is to find how to put the unsatisfied 
bonds represented by the crosses. Since the unsatisfied bonds arc regarded 
as some kind of constraints, this situation is similar with the traveling sales- 
man problem in which there are some constraints as mentioned before. We 
explain two topics in this section. In the first half, we consider the order 
by disorder effect in fully-frustrated systems. In the last half, we explain 
non-monotonic dynamics in decorated bond systems. 

5.2.1. Thermal Fluctuation and Quantum Fluctuation Effect of 
Geometrical Frustrated Systems 

In general, there are many degenerated ground states in geometrical frus- 
trated systems such as triangular antiferromagnetic Ising spin systems and 
kagomc antiferromagnetic Ising spin systems. In these cases, non-zero resid- 
ual entropy which is entropy at zero temperature exists. Typical configu- 
rations of ground states of the triangular antiferromagnetic Ising spin sys- 
tems are shown in Fig. 11. The residual entropy per spin of this system is 
Sits — 0.323fcs, 145 ~ 148 where k^ is the Boltzmann constant. Since the total 
entropy per spin is /cb hi 2 ~ 0.693fcB, 46.6% of the total entropy remains 
even at zero temperature. In other words, there are macroscopic degen- 
erated ground states in this system. In the antiferromagnetic Ising spin 
system on kagome lattice, there are also macroscopic degenerated ground 
states. The residual entropy per spin of this system is Ores — 0.502kb, 
which is 72.4% of the total entropy. 149 

Suppose we apply the simulated annealing or the quantum annealing 
with slow schedule for geometrical frustrated spin systems. Since there are 
macroscopically degenerated ground states in these systems, our purpose is 
to clarify whether all ground states are obtained with the same probabil- 
ities or biased probabilities. We first consider the obtained ground states 
in the case of the simulated annealing with slow schedule. If we decrease 
temperature slow enough, the obtained state should satisfy the equilibrium 
probability distribution. When the temperature is k^T -C \J\, the equilib- 
rium probabilities of the ground states are dominant and that of any excited 
states can be neglected. The principle of equal weight which is the keystone 
in the equilibrium statistical physics says that if the eigenenergies of the 
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Fig. 11. Typical configurations of ground states of antifcrromagnctic Ising spin system 
on triangular lattice. The open and solid circles arc the +l-state and the — 1-state, 
respectively. The dotted circles indicate free spin where the molecular field is zero. 

microscopic state and E^ are the same, the equilibrium probability 
of Yia an d that of Eg are also the same. Then we obtain all macroscopic 
degenerated ground states with the same probability after the simulated 
annealing with slow schedule. 

Next we consider the obtained ground states in the case of the quantum 
annealing where the transverse field decreases slow enough. Here we assume 
that the initial state is set to be the ground state of the Hamiltonian at 
the initial time. In order to capture the feature of the ground states in a 
graphical way, it is convenient to introduce the concept of free spin where 
the molecular field is zero. The molecular field at the i-th site is given by 

hfV :=J5>|, (149) 

o 

where the summation runs over the nearest-neighbor sites of the i-th site. 
For instance, in Fig. 11, spins indicated by dotted circles are free spins. 
Here, the transverse field is expressed as 

-r£a? = -r2>+ + *r), (150) 

i i 

where af and u~ denote the raising and lowering operators at the z-th site, 
respectively. They are defined by 




(151) 



The x-component of the Pauli matrix corresponds to the operator which 
flips the considered spin: 

<nt} = l+>, <H4> = lt>- (152) 
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From this, the states which have large number of free spins are expected to 
become stable at the limit of V — >• 0+ and T = 0. Actually, in the adiabatic 
limit, the amplitudes of the states which have the maximum number of free 
spins are larger than the others. 150-154 When we decrease the transverse 
field slow enough, the state at each time can be well approximated by the 
ground state of the instantaneous Hamiltonian. Then we obtain specific 
ground states with high probability after the quantum annealing with slow 
schedule. 

In this section, we considered the thermal fluctuation effect and the 
quantum fluctuation effect in the adiabatic limit. The simulated anneal- 
ing can obtain all the ground states with the same probability, while on 
the other hand, the quantum annealing can obtain specific ground states 
in this limit. The biased probability distribution can be explained by the 
character of the quantum Hamiltonian. The selected states should depend 
on how to choice the quantum Hamiltonian. When we adopt the exchange 
type interaction as the quantum field, the states that have the maximum 
value of the "free spin pair" should be selected. Moreover, it is an interest- 
ing topic to investigate differences between the simulated annealing and the 
quantum annealing with finite speed not only in terms of the quantum an- 
nealing but also in noncquilibrium statistical physics and condensed matter 
physics. At the present stage, to consider dynamic phenomena in strongly 
correlated systems is difficult, since a small number of theoretical methods 
for obtaining dynamic phenomena have been developed. If the technology 
of the artificial lattices develops more than ever, real-time dynamics and 
time-dependent phenomena of frustrated spin systems can be observed in 
real experiments. 



5.2.2. Non-Monotonic Behavior of Correlation Function in 
Decorated Bond System 

In the ferromagnetic Ising spin systems, the correlation function behaves 
monotonic against the temperature and transverse field. However, the be- 
havior of the correlation function is non-monotonic as a function of tem- 
perature in some frustrated spin systems. As an example of non-monotonic 
correlation function, we introduce equilibrium properties of the correlation 
function in decorated bond systems in which the frustration exists. The 
Hamiltonian of the decorated bond systems where the number of system 
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spins is two shown in Fig. 12 is given by 

H = -.hu^al - J^sf {at + a}), (153) 

i=l 

where erf = ±1 and sf = ±1 are, respectively, called system spins and 
decorated spins, and is the number of decorated spins. The circles and 
the squares in Fig. 12 represent the system spins and the decorated spins, 
respectively. 

When the direct interaction between system spins Jdir is zero and the 
decorated bond J is positive, the correlation function between system spins 
( a i rT 2) i s always positive and monotonic decaying function against the tem- 
perature. When the direct interaction between system spins Jdi r is negative 
and the decorated bond J is zero, on the other hand, the correlation func- 
tion (erf erf) is always negative and monotonic increasing function against 
the temperature. From this, the correlation function (erf erf ) is expected to 
behave non-monotonic in some cases for negative J^h- and positive J or 
positive Jdir and negative J. In order to obtain temperature dependence 
of the correlation function between system spins, we trace over spin states 
except the system spins: 

Tr H} e-^ = Ae*""*"* , (154) 

where A is just a constant which does not affect any physical quantities 
and the effective coupling K e g is given by 

K e g = ^lncosh(2/3J) +/?J dir . (155) 
Temperature dependence of the correlation function between system spins 



Fig. 12. Decorated bond system where the number of system spins is two and the 
number of decorated spins is four (N^ = 4). The circles and squares represent system 
spins and decorated spins, respectively. The dotted and solid lines indicate the direct 
interaction between system spins and the decorated bonds, respectively. 
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tanhi4T ff . 

(156) 

Hereafter we set J as the energy unit and J is positive. In order to compare 
the effect of the direct interaction fairly, we assume the form such as 
■^dir = —xN^J. This is because the effective coupling K e g is proportional 
to the number of decorated spins under the assumption. 

Figure 13 shows temperature dependence of correlation function be- 
tween the system spins for = 1 and Na = 10 for several x. For small 
x and large x, the correlation function C^°'(T) is monotonic decreasing 
and increasing functions, respectively, against the temperature. However, 
the correlation function C^ C '(T) behaves non-monotonic as a function of 
temperature for intermediate x. At the temperatures where the effective 
coupling K c ff is larger than the critical value of the ferromagnetic Ising 
spin system on square lattice 19 ^ sc * uarc ) = |ln(l + \/2), ferromagnetic 
phase appears. On the other hand, at the temperature where K e g is less 
than „^- ( ( l5t i ualc ) 5 antiferromagnetic phase appears. In this case, successive 



is represented by using A ff : 

Trofcrfe-^ _ Tr erjerf c K <= ffCT ^ 



C^(T) := 



Tre -/3W Tre K c 



1 

0.75 
0.5 
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Fig. 13. The correlation function between system spins C^(T) as a function of tem- 
perature for N d = 1 (left panel) and for 7Y d = 10 (right panel) in the cases of x = 0.1, 
0.2, 0.5, 1.0, and 2.0. 
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phase transitions such as paramagnetic — s- antifcrromagnctic — s- param- 
agnetic — > ferromagnetic phases occur. Such phase transitions are called 
reentrant phase transitions which are sometimes appeared in frustrated 
systems. 115 ' 139 ' 155 - 160 

We consider transverse field response of the decorated bond systems 
in the ground state. The Hamiltonian of the decorated bond system with 
transverse field is expressed as 



H 



- J dir Sf<7f - jJ2 § i (*i + *a ) - r (°i + *a 



Na 
i=l 



), (157) 



where sf denotes the a-component of the Pauli matrix of the i-th deco- 
rated spin. Here we consider transverse-field dependence of the correlation 
function in the ground state given by 



C (q) (r) := (^)(T)\ala* 2 \ip&\r)), 



(158) 



where \i/j^ es ' (r)) denotes the ground state at the transverse field T. Figure 14 
shows transverse-field dependence of CW (r) for = 1 and = 10 for 
several x. 
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Fig. 14. The correlation function between system spins C' q ) (T) as a function of trans- 
verse field for 7V d = 1 (left panels) and for N d = 10 (right panels) in the cases of x = 0.1, 
0.2, 0.5, 1.0, and 2.0. 
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For small x and large x, the correlation function C^ q ^(r) behaves mono- 
tonic decreasing and increasing, respectively as a function of transverse 
field, whereas for intermediate a;, transverse-field dependence of the corre- 
lation function behaves nonmonotonic as well as the case of thermal fluc- 
tuation. Then, the reentrant phase transition also occurs by changing the 
transverse field. However there is a difference between the thermal fluc- 
tuation effect and the quantum fluctuation effect for decorated bond sys- 
tem. The temperature where C^ C '(T) — is satisfied is the same when we 
change the number of decorated spins N^, whereas the transverse field at 
C*- q )(T) = is different when is changed. 

The thermal fluctuation and the quantum fluctuation have similar prop- 
erties for the phase transition phenomena in general. Indeed, the reentrant 
phase transitions occur by changing the thermal fluctuation and also the 
quantum fluctuation as shown in this section. However as described in 
Sec. 5.1, in order to obtain the best solution of optimization problems, 
it is better to erase phase transition. By dealing with thermal and quantum 
fluctuation effects for frustrated systems exhaustively, we can construct the 
best form of the adding fluctuation which erases phase transition 6 . 

6. Conclusion 

In this paper, we described some aspects of the quantum annealing from 
viewpoints of statistical physics, condensed matter physics, and computa- 
tional physics. Originally, the quantum annealing has been proposed as a 
method which can solve efficiently optimization problems in a generic way. 
Since many optimization problems can be mapped onto the Ising model or 
generalized Ising model such as the clock model and the Potts model, it 
has been considered that we can obtain a better solution by using methods 
which were developed in computational physics. For instance, we can obtain 
a better solution by decreasing temperature (thermal fluctuation) gradu- 
ally in the simulated annealing which is one of the most famous practical 
methods. In the quantum annealing, we decrease an introduced quantum 
field (quantum fluctuation) instead of temperature (thermal fluctuation). 
In many studies, it was reported that a better solution can be obtained 



e It is not necessary that the adding fluctuation is restricted in quantum physics. From a 
viewpoint of optimization problems, we can arbitrary form adding term. Furthermore, it 
has studied that other novel fluctuation which may be able to erase phase transition as 
an alternative to thermal and quantum fluctuations. 14 ' 116 ' 161,162 Of course, if we want 
to realize experimentally, it is better that the added fluctuation term should be some 
kind of quantum fluctuation. 
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by the quantum annealing efficiently in comparison with the simulated an- 
nealing as we explained in Sec. 4. Thus, the quantum annealing method is 
expected to be a generic and powerful solver of optimization problems as 
an alternative to the simulated annealing. 

The quantum annealing has become a milestone of some related fields 
under the situation in which the quantum annealing itself has been studied 
exhaustively. Since we use the quantum fluctuation in the quantum an- 
nealing with ingenuity, to obtain a better solution by using the quantum 
annealing is a kind of quantum information processing. Thus, many imple- 
mentation methods of the quantum annealing in theoretical and experimen- 
tal ways have been proposed by many researchers. A number of theoretical 
implementation methods are proposed based on knowledge of statistical 
physics. As we shown in Sec. 5, question of what are differences between 
the simulated annealing and the quantum annealing and question of which 
is efficient in the given optimization problem are catalysts to investigate 
differences between the thermal fluctuation and the quantum fluctuation 
in a deeper way. On top of that, studies on the quantum annealing are ex- 
pected to open the door to consider equilibrium and nonequilibrium statis- 
tical physics. Recently, preparation methods of intended Hamiltonian have 
been established in some experimental systems such as artificial lattices and 
nuclear magnetic resonance because of recent development of experimental 
techniques. As long as we use classical computer and our present knowledge, 
there are a huge number of problems where to obtain the best solution is 
difficult without any and every approximation in theoretical methods. How- 
ever if we prepare the Hamiltonian which expresses our intended problem, 
we can calculate experimentally the stable state of the prepared Hamilto- 
nian in near future. 

The quantum annealing transcends just a method for obtaining the best 
solution of optimization problems and it will make a development in wide 
area of science. Although it seems that studies on the quantum annealing 
itself have been well established, we believe that the quantum annealing 
plays a role as a bridge with the abovementioned area of science and the 
quantum information. 
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